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Abstract 


Defence  R&D  Canada  (DRDC)  anticipates,  assesses,  and  provides  advice  about  the  impact  of 
emerged  and  emerging  technologies  to  ensure  that  the  Canadian  Forces  are  technologically 
prepared.  In  201 1,  DRDC  is  considering  Virtual  Reality  and  Neural  Interfaces  as  a  potentially 
disruptive  technology  (PDT).  The  purpose  of  this  position  paper  is  to  help  inform  views  on  the 
use  of  virtual  reality  (VR)  for  military  training  by  providing  answers  to  specific  questions  that 
were  posed  by  the  DRDC  examining  committee.  The  questions  sought  (1)  a  definition  of  the 
technology,  (2)  analysis  of  its  potential  for  disrupting  defence  and  security,  (3)  identification  of 
key  barriers  and  key  drivers  for  the  use  of  the  technology,  and  (4)  an  assessment  of  the  maturity 
of  the  technology.  The  main  conclusions  of  this  position  paper  are  that  VR  has  been  and 
continues  to  be  a  disruptive  training  technology,  for  friendly  and  opposing  forces,  and  that  VR,  if 
used  for  embedded  training,  could  provide  a  means  to  regain,  with  the  help  of  other  enabling 
disruptive  technologies,  a  training  advantage  that  has  been  lost  with  the  proliferation  of 
technology. 


Resume 


R  &D  pour  la  defense  Canada  (RDDC)  anticipe  et  evalue  les  effets  des  nouvelles  technologies  et 
agit  comme  expert-conseil  en  la  matiere  aupres  des  Forces  canadiennes  afm  d’aider  celles-ci  a 
demeurer  pretes  sur  le  plan  techno logique.  En  20 1 1 ,  RDDC  etudie  la  realite  virtuelle  (RV)  et  les 
interfaces  neuronales  comme  technologies  de  potentiellement  perturbatrices  (TRP).  Dans  le 
present  expose  de  principes,  nous  expliquerons  comment  la  RV  pourrait  etre  mise  au  service  de 
l’instruction  militaire  en  repondant  a  des  questions  precises  du  comite  d’examen  de  RDDC.  Ce 
dernier  a  demande  que  :  ( 1 )  nous  defmissions  la  technologie  en  question;  (2)  que  nous  analysions 
son  potentiel  en  tant  que  technologie  potentiellement  perturbatrice  dans  les  domaines  de  la 
defense  et  de  la  securite;  (3)  que  nous  cemions  les  principaux  facteurs  favorables  et  defavorables 
a  l’emploi  de  cette  technologie;  (4)  et  que  nous  evaluions  sa  maturite.  Nous  concluons  que  la  RV 
est  et  continuera  d’etre  une  technologie  perturbatrice  qu’utilisent  les  forces  alliees  et  adverses  et 
que,  si  nous  l’utilisons  aux  fins  d’instruction  integree,  elle  pourrait  nous  permettre  de  reprendre 
sur  nos  adversaires  conventionnels  et  asymetriques  un  avantage  que  nous  avions  perdu  en  raison 
de  la  proliferation  de  cette  technologie. 
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Executive  summary 


Virtual  Reality  (VR)  as  a  Disruptive  Technology: 

Magee,  L.E.;  DRDC  Toronto  TM  2011-114;  Defence  R&D  Canada  -  Toronto;  July 
2011. 

Introduction 

Defence  R&D  Canada  (DRDC)  anticipates,  assesses,  and  provides  advice  about  the  impact  of 
emerged  and  emerging  technologies  to  ensure  the  Canadian  Forces  are  technologically  prepared. 
In  201 1,  DRDC  is  considering  Virtual  Reality  and  Neural  Interfaces  as  a  potentially  disruptive 
technology  (PDT).  The  purpose  of  this  position  paper  is  to  help  inform  views  on  the  use  of  virtual 
reality  (VR)  for  military  training  by  providing  answers  to  specific  questions  that  were  posed  by 
the  DRDC  examining  committee.  The  questions  sought  ( 1 )  a  definition  of  the  technology,  (2) 
analysis  of  its  potential  for  disrupting  defence  and  security,  (3)  identification  of  key  barriers  and 
key  drivers  for  the  use  of  the  technology,  and  (4)  an  assessment  of  the  maturity  of  the 
technological. 

What  is  this  technology? 

VR  technologies  can  provide  an  interface  to  human-in-the-loop  systems  and  components  that  can 
be  assembled  to  enable  a  user  to  sense  and  interact  with  a  virtual  environment  (VE).  VR  systems 
can  consist  of  real  or  synthetic  parts  and  can  include  animate  or  inanimate  objects.  The  human 
interface  of  a  VR  system  often  stimulates  several  human  senses  at  the  same  time  to  promote  the 
perception  of  immersion,  which  is  a  sense  of  presence  in  the  VE.  The  enabling  technologies  are 
often  first  developed  for  the  entertainment  market  and  are  repuiposed  for  use  in  military  training. 
This  origin  of  the  enabling  technologies  as  well  as  their  ease  of  assembly  as  a  flexible,  low-cost, 
portable  training  system  distinguishes  VR  systems  from  conventional  simulators  used  for 
training. 

What  is  potentially  disruptive  to  defence  and  security? 

VR  systems  are  eroding  the  training  advantages  that  were  gained  by  large  investments  in  military 
modelling  and  simulation  (M&S).  The  proliferation  of  commercial  technologies,  including 
computer  graphics  and  high-speed  networking  technologies,  has  allowed  friendly  and  opposing 
forces  an  opportunity  to  conduct  individual  and  team  training  within  a  distributed  virtual 
environment.  While  this  development  provides  an  opportunity  for  the  Canadian  Forces  to  reduce 
costs  and  to  avoid  the  many  constraints  on  training  imposed  by  the  availability  of  people, 
resources,  safety  and  environmental  concerns,  adversaries  can  now  train  unobserved,  at  low  cost. 
This  could  result  in  training  surprise.  A  means  of  regaining  a  training  advantage  is  to  exploit  VR, 
and  other  potentially  disruptive  technologies,  for  embedded  training, 

What  are  key  barriers? 

VR  is  acknowledged  as  a  hard  problem;  enabling  technology  for  some  applications  is  lacking 
(e.g.,  a  means  for  natural  locomotion  within  a  virtual  environment).  A  deficiency  of  human 
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factors  knowledge,  negative  attitudes  toward  simulator-based  training,  naive  beliefs  about  fidelity 
requirements,  clashing  commercial  objectives  and  the  lack  an  overarching  policy,  plan,  or  body 
for  managing  and  applying  M&S  as  a  corporate  resource  within  the  Department  of  National 
Defence  (DND)  are  barriers  to  the  use  of  VR  for  military  training. 

What  are  key  drivers? 

The  rapid  change  in  demands  upon  the  military,  non-traditional  activities,  uncertainty  about  the 
strategic  environment  and  a  growing  use  of  network-enabled  capabilities  in  operational  systems 
are  some  reasons  why  reconfigurable,  portable,  and  embedded  VR  training  solutions  are  needed. 
The  costs,  risks,  constraints  and  resource  demands  (on  people  and  equipment)  associated  with 
training  on  operational  equipment  or  full-mission  simulators  at  home  are  other  reasons  for 
seeking  affordable  VR  as  an  alternative.  Technological  pull  is  another  driver. 

What  is  the  maturity  of  the  technology? 

VR  systems  are  enabled  by  components  that  range  in  maturity.  The  efficacy  of  their  assembly  as  a 
system  depends  upon  the  application,  the  performance  objectives  for  the  system,  and  the 
characteristics  of  the  users.  Emerging  technologies,  such  as  augmented  reality  and  human 
behavioural  modelling  are  less  mature,  but  offer  new  possibilities  to  extend  the  use  of  VR  as  a 
solution  for  military  training  by  enabling  virtual  simulation  for  embedded  training.  The 
continuing  advance  of  technologies  such  as  these,  with  the  advance  of  a  human  sciences 
foundation,  affords  a  means  to  outpace  agile  adversaries  able  to  take  advantage  of  the 
proliferation  of  technologies  that  can  be  adapted  to  training. 


Conclusions 

The  main  conclusions  of  this  position  paper  are  that  VR  has  been  and  continues  to  be  a  disruptive 
technology,  for  friendly  and  opposing  forces,  and  that  VR,  with  the  help  of  other  disruptive 
technologies,  could  provide  a  means  to  gain  a  military  training  advantage  over  conventional  or 
asymmetric  adversaries  if  it  is  used  for  embedded  training. 
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Virtual  Reality  (VR)  as  a  Disruptive  Technology: 

Magee,  L.E.;  DRDC  Toronto  TM  2011-114;  R  &  D  pour  la  defense  Canada  - 
Toronto;  juillet  2011. 

Introduction 

R  &  D  pour  la  defense  Canada  (RDDC)  anticipe  et  evalue  les  effets  des  nouvelles  technologies  et 
agit  comme  expert-conseil  en  la  matiere  aupres  des  Forces  canadiennes  afm  d’ aider  celles-ci  a 
demeurer  pretes  sur  le  plan  technologique.  En  201 1,  RDDC  etudie  la  realite  virtuelle  (RV)  et  les 
interfaces  neuronales  comme  technologies  potentiellement  perturbatrices  (TPP).  Dans  le  present 
expose  de  principes,  nous  expliquerons  comment  la  RV  pourrait  etre  mise  au  service  de 
l’instruction  militaire  en  repondant  a  des  questions  precises  du  comite  d’examen  de  RDDC.  Ce 
dernier  a  demande  que  :  (1)  nous  defmissions  la  technologie  en  question;  (2)  que  nous  analysions 
son  potentiel  en  tant  que  technologie  potentiellement  perturbatrice  dans  les  domaines  de  la 
defense  et  de  la  securite;  (3)  que  nous  cemions  les  principaux  facteurs  favorables  et  defavorables 
a  l’emploi  de  cette  technologie;  (4)  et  que  nous  evaluions  sa  maturite. 

Qu’est-ce  que  cette  technologie? 

La  technologie  de  RV  peut  servir  d’interface  a  un  systeme  avec  intervention  humaine  en  y 
integrant  des  elements  qui,  une  fois  assembles,  permettent  a  l’utilisateur  d’interagir  avec  un 
environnement  virtuel  et  de  ressentir  les  choses  qui  s’y  passent.  Les  systemes  de  RV  peuvent  etre 
composes  d’elements  reels  ou  synthetiques  et  avoir  recours  a  des  objets  animes  ou  inanimes. 
L’interface  humaine  d’un  systeme  de  RV  stimule  plusieurs  des  sens  humains  en  meme  temps  afm 
d’accroitre  la  profondeur  de  l’immersion,  c’est-a-dire  le  sentiment  d’etre  present  dans 
L environnement  virtuel.  Les  technologies  habilitantes  sont  souvent  conges  d’abord  pour  le 
marche  du  divertissement,  puis  sont  reconverties  plus  tard  en  systemes  d’entrainement  militaire. 
Aussi,  leur  facilite  d’ assemblage,  leur  flexibilite,  leur  abordabilite  et  leur  mobilite  sont  autant  de 
caracteristiques  qui  distinguent  les  systemes  de  RV  des  simulateurs  d’entrainement 
conventionnels. 

En  quoi  cette  technologie  est-elle  potentiellement  perturbatrice  sur  le  plan  de  la  defense  et 
de  la  securite? 

La  presence  des  systemes  de  RV  diminue  les  avantages  sur  le  plan  de  l’entrainement  acquis  grace 
aux  grandes  sommes  investies  dans  les  technologies  de  modelisation  et  de  simulation  (M  &  S) 
militaires.  La  proliferation  des  technologies  commerciales  telles  que  l’infographie  et  les  reseaux 
haute  vitesse  a  permis  tant  aux  forces  alliees  qu’ennemies  de  mener  des  entrainements  individuels 
et  collectifs  dans  un  environnement  virtuel  reparti.  Bien  que  ces  avancees  offfent  l’occasion  aux 
Forces  canadiennes  de  reduire  leurs  depenses  et  de  contoumer  les  nombreux  obstacles  a 
l’entrainement  crees  par  les  manques  de  personnel  et  de  ressources  ainsi  que  par  differents  soucis 
lies  a  la  securite  et  a  1’ environnement,  les  forces  ennemies  peuvent  desormais  s’entrainer  a  l’abri 
des  regards  et  a  des  couts  peu  eleves.  Cela  peut  done  causer  quelques  surprises.  Un  bon  moyen  de 
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reprendre  l’avantage  serait  d’exploiter  la  RV  et  d’autres  technologies  potentiellement 
perturbatrices  permettant  la  mise  en  oeuvre  d’une  instruction  integree. 


Quels  sont  les  principaux  facteurs  defavorables? 

11  est  connu  que  la  RV  pose  un  probleme  complexe.  En  effet,  pour  certaines  de  ses  applications, 
nous  ne  disposons  pas  de  la  technologie  habilitante  necessaire  (p.  ex.,  qui  permettrait  une 
locomotion  naturelle  a  l’interieur  d’un  environnement  virtuel).  11  existe  de  nombreux  facteurs  qui 
font  obstacles  a  1’application  de  la  RV  a  l’instruction  militaire  conime  :  un  manque  de 
connaissance  a  propos  des  facteurs  humains,  une  attitude  negative  vis-a-vis  l’entrainement  sur 
simulateur,  des  croyances  nai'ves  a  propos  des  exigences  en  matiere  de  fidelite,  des  objectifs 
commerciaux  divergents  et  l’absence  d’une  politique,  d’un  plan  ou  d’un  cadre  d’ensemble  pour  la 
gestion  et  l’emploi  de  la  M  &  S  en  tant  que  ressource  du  ministere  de  la  Defense  nationale 
(MDN). 

Quels  sont  les  principaux  facteurs  favorables? 

La  rapidite  avec  laquelle  change  la  demande  envers  les  forces  militaires,  les  activites  non 
traditionnelles,  l’incertitude  ambiante  par  rapport  a  1’ environnement  strategique  et  l’usage 
croissant  de  ressources  reseaucentriques  dans  les  systemes  operationnels  sont  quelques  raisons 
qui  expliquent  pourquoi  il  serait  avantageux  de  disposer  de  solutions  reconfigurables,  portables  et 
integrees  d’instruction  en  RV.  Par  ailleurs,  si  l’on  tient  compte  des  couts,  des  risques,  des 
difficultes  et  des  besoins  en  ressources  humaines  et  materielles  associes  a  l’utilisation 
d’equipement  operationnel  ou  de  simulateurs  de  mission  complete  au  pays,  il  ne  peut  qu’etre 
profitable  de  nous  toumer  vers  la  RV,  qui  constitue  une  solution  abordable.  Enfin,  le  courant 
technologique  est  aussi  un  facteur  non  negligeable. 

Quel  est  le  stade  de  maturite  de  cette  technologie? 

Les  systemes  de  RV  fonctionnent  a  l’aide  de  composantes  dont  la  maturite  technologique  est 
variable.  Ainsi,  l’efficacite  de  ces  composantes  reunies  depend  de  leur  utilisation,  des  objectifs  de 
rendement  du  systeme  et  des  caracteristiques  des  utilisateurs.  Les  technologies  naissantes  telles 
que  la  realite  amplifiee  et  la  modelisation  de  comportements  humains  n’ont  pas  atteint  un  stade  de 
maturite  tres  eleve,  mais  offrent  neanmoins  de  nouvelles  possibility  d’utilisation  de  la  RV 
comme  solution  a  des  fins  d’instruction  militaire  en  permettant  la  simulation  virtuelle 
d’instruction  integree.  En  realisant  des  progres  constants  dans  ces  domaines  technologiques  et  en 
y  integrant  la  composante  humaine,  nous  serons  en  mesure  de  distancer  des  adversaires  ingenieux 
capables  de  tirer  avantage  de  la  proliferation  des  technologies  pouvant  etre  adaptees  a 
l’instruction  militaire. 


Conclusions 

Dans  notre  expose  de  principes,  nous  concluons  que  la  RV  est  et  continuera  d’etre  une 
technologie  perturbatrice  qu’utilisent  les  forces  alliees  et  adverses  et  que,  jumelee  a  d’autres 
technologies  perturbatrices,  elle  pourrait  nous  permettre  de  reprendre  un  avantage  sur  nos 
adversaires  conventionnels  et  asymetriques  si  nous  l’utilisons  aux  fins  d’instruction  integree. 
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1  What  is  this  technology? 


Virtual  reality  (VR)  is  the  name  given  to  the  technologies  that  allow  an  operator  to  sense  and 
interact  with  a  three-dimensional  environment  that  is  different  from  the  one  in  which  the  operator 
is  physically  present.  Within  this  domain  are  teleoperation,  teleorobotics,  synthetic  or  simulated 
environments  (SE),  cyberspace,  first-person  shooter  games  and  augmented,  fused,  or  mixed 
realities.  These  terms  commonly  refer  to  a  system  composed  of  a  human  user,  a  machine,  and  a 
human-machine  interface  connecting  the  user  to  a  computer-generated,  or  remote,  spatial 
environment,  often  called  a  virtual  environment  (VE).  The  VE  can  include  representations  of  real, 
synthetic,  animate  or  inanimate  components  alone  or  together.  The  human  interface  of  a  VR 
system  often  stimulates  several  human  senses  at  the  same  time  to  promote  the  perception  of 
immersion  within  the  VE.  These  effects  are  usually  enhanced  with  the  help  of  sensors  and 
controls  that  allow  self-directed  movement  within  the  spatial  environment  and  natural  real-time 
interactions,  including  spoken  interactions,  with  animated  virtual  characters  (avatars).  The 
technologies  that  enable  VR  are  often  first  developed  for  the  entertainment  market;  they  are  then 
repurposed  for  use  in  military  training.  This  characteristic  of  VR  systems,  as  well  as  their 
relatively  low-cost,  portability  and  re-configurability,  distinguish  them  from  simulators  typically 
used  for  training. 
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2  What  is  potentially  disruptive  to  defence  and 
security? 


VR  provides  an  accessible  and  affordable  alternative  to  full  mission  simulators,  which  have  been 
the  traditional  means  of  exploiting  modeling  and  simulation  (M&S)  for  training.  VR  can  exploit 
enormous  investments  in  M&S.  The  United  States  (US)  has  identified  M&S  as  a  critical 
technology  [1]  and  the  Department  of  National  Defence  (DND)  of  Canada  has  identified  M&S  as 
an  enabling  technology  for  transformation  [2,  3].  While  VR  systems  may  not  provide  all  the 
functionality  of  a  traditional  simulator,  they  sometimes  provide  a  more  compelling  means  of 
achieving  immersion  within  a  training  environment.  This  effect  is  often  sought  to  promote 
situational  awareness  and  training  transfer.  VR  training  systems  differ  from  traditional  simulators 
in  several  other  ways.  They  are  less  reliant  on  physical  reproductions  of  the  operational 
equipment  (e.g.,  a  cockpit),  and  they  are  more  portable,  more  reconfigurable,  less  dependent  on 
proprietary  software  or  hardware,  and  are  much  less  expensive  to  buy  and  to  maintain.  In 
addition,  VR  solutions  are  sometimes  better  suited  to  specific  training  objectives  than  full  mission 
simulators  because  the  human  interface  of  a  VR  system  can  be  more  easily  customized  to  match  a 
particular  training  objective  and  its  requirements,  for  example,  the  presentation  of  stereoscopic 
images  for  making  accurate  visual  judgements  of  the  distance  to  an  object  or  a  surface.  Hence, 

VR  is  well-suited  to  part-task  training,  mission  planning  and  mission  rehearsal  applications  where 
specific,  rather  than  comprehensive,  learning  objectives  can  be  identified.  This  feature  ofVR 
training  systems  does  not  necessarily  limit  the  impact  that  they  can  have  on  subsequent  task 
performance  since  part-task  training  can  be  very  effective  and  surprising  when  put  to  practice.  For 
example,  the  terrorists  of  9/1 1  did  not  need  to  know  how  to  take  off  or  land  the  aircraft  that  they 
guided  to  impact. 

Since  there  are  many  uses  of  VR,  training  applications  can  leverage  advances  made  for  other 
purposes,  such  as  gaming  [4].  Moreover,  VR  systems  can  train  a  greater  range  of  tasks  than 
traditional  simulators,  which  are  usually  used  to  train  only  one  or  a  few  individuals  to  operate  a 
vehicle  of  some  kind  (e.g.,  a  tank).  The  Future  Immersive  Training  Environment  (FITE)  Joint 
Capability  Technology  Demonstration  (JCTD)  illustrates  that  VR  training  systems  can  be  applied 
more  broadly.  The  first  operational  demonstration  of  the  FITE  system  provided  training  for 
small-unit  ground  forces  by  equipping  soldiers  with  a  head-mounted  display  system  linked  to  a 
“serious”  game  (Virtual  Battle  Space  2).  An  independent  assessment  of  the  FITE  system  provided 
subjective  evidence  of  its  apparent  utility  and  indicated  that  squads  would  be  ready  to  use  the 
system  as  configured  to  help  them  prepare  for  combat  deployments  [5].  Since  VR  can  take 
advantage  of  ready  access  to  open-source  data  for  simulating  realistic  objects,  geo-specific 
terrain,  environmental  conditions,  dynamic  interactions  and  complex  scenarios,  VR  provides  an 
opportunity  for  the  Canadian  Forces  (CF)  to  gain  many  of  the  advantages  of  simulator-based 
training  at  low  cost. 

However,  VR  also  provides  a  threat  since  adversaries  with  few  resources  can  exploit  the  same 
capabilities  to  acquire  skills  previously  taught  to  the  military  of  wealthy  nations.  In  other  words, 
adversaries  can  use  VR  for  a  training  surprise.  They  can  also  now  make  use  of  computer 
networking  technologies  with  capabilities  that  were  previously  exclusive  to  our  allies  for  team 
training.  Simulator  networking  was  conceived  decades  ago  to  allow  a  large  number  of  simulators 
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to  be  interconnected  [6],  locally  or  over  a  wide  area,  for  collective,  coalition  and  joint  training. 
Computer  game  technologies  and  commercial,  wide  band  communication  systems  now  allow 
adversaries  ready  access  to  this  capability.  Consequently,  adversaries  can  train  as  a  team, 
interactively  plan  a  mission,  or  rehearse  a  scenario  without  having  to  invest  in  expensive 
equipment,  conspicuous  infrastructure,  or  travel  to  a  common  meeting  place. 

The  affordability  and  flexibilities  of  VR  training  systems  allow  use  of  simulator  networking  for  a 
wide  variety  of  team  training  applications  and  there  are  current  examples  showing  that  the  CF  has 
begun  to  take  advantage  of  this  opportunity  in  a  limited  way;  examples  include  the  development 
of  the  Mission  Rehearsal  Tactical  Trainer  (MRTT)  for  training  aircrew,  as  part  of  the  Canadian 
Advanced  Synthetic  Environment  (CASE)  project,  and  the  use  of  Virtual  Battle  Space  2  by  the 
Land  Forces  for  training  small  unit  command  and  control.  However,  experimental  evidence  of  the 
training  effectiveness  of  these  systems  remains  to  be  collected  [7].  This  knowledge  gap  points  to 
the  need  for  informed  decisions  about  the  design  and  use  of  technologies  for  training  and  the  need 
for  objective,  human  behavior-based  evidence  of  the  effectiveness  of  VR  training  systems.  The 
knowledge  gap  also  suggests  that  a  promising  means  of  regaining  the  training  advantage  that  has 
been  lost  with  the  proliferation  of  technology  is  to  become  better  informed  about  its  exploitation 
and  the  sciences  of  human  learning  and  knowledge  and  skill  retention.  This  is  consistent  with  a 
fundamental  shift  from  the  belief  that  better  weapons  will  provide  superior  readiness  to  a  belief 
that  well  trained  soldiers  who  are  able  to  deal  with  complex,  uncertain  operational  challenges  are 
vital  to  success  on  the  battlefield  [8]. 

The  use  of  VR  in  operational  systems  has  implications  for  training.  VR  for  teleoperation  and 
teleorobotics  can  potentially  benefit  system  performance  by  improving  the  situational  awareness, 
ease  of  use,  and  the  workload  experienced  by  a  human  operator.  Consequently,  the  training 
barrier  to  proficient  performance  could  be  less.  This  is  a  training  outcome  that  could  have 
advantages  and  disadvantages  since  it  could  be  exploited  by  both  friendly  and  opposing  forces. 
Another  disruptive  relationship  between  operational  system  design  and  training  is  the  use  of  VR 
for  embedded  training  (ET).  The  idea  of  ET  is  to  make  maximal  use  of  operational  equipment  for 
military  training  by  including  or  appending  enabling  technology  [9].  The  potential  advantages  of 
ET  include  access  to  training  during  deployment  [10,1 1]  and  opportunity  for  just-in-time  training, 
mission  planning  and  mission  rehearsal  in  theatre.  These  advantages  could  allow  our  forces  to 
avoid  knowledge  and  skill  decay  during  lengthy  deployments  and  also  provide  a  means  to  modify 
training  in  theatre  to  counter  an  adapting  adversary.  ET  for  mission  planning  and  rehearsal  allows 
intelligence  exploitation1  and  could  be  used  to  better  prepare  our  forces  for  upcoming  combat 
operations  by  harnessing  the  potential  of  other  potentially  disruptive  technologies,  such  as  wide¬ 
band,  mobile,  wireless  networking  and  the  networked-enabled  capabilities  of  operational 
equipment.  New  sensor  and  display  technologies  and  the  growing  use  of  interconnected  and 
interdependent  military  systems  present  a  new  opportunity  for  gaining  training  advantages. 

Several  consecutive  studies  by  the  North  Atlantic  Treaty  Organisation  (NATO)  Research  and 
Technology  Organization  have  evaluated  advances  of  VR  (including  augmented  reality)  for 
military  applications  (see  [12]  for  a  summary).  In  the  first  of  these,  education  and  training  was 
identified  as  the  most  promising  application  area.  Subsequent  Research  Task  Groups  have 
narrowed  in  on  the  potential  of  embedded  virtual  simulation  (EVS)  as  a  means  of  enhancing  ET, 
which  could  help  military  units  deploy  on  short  notice  and  help  them  adapt  to  changing 
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operational  situations.  Schlick  &  Alexander  [12]  have  recently  drafted  a  position  paper  for  NATO 
concerning  long  term  capability  requirements  and  they  conclude  that  EVS  is  a  potentially 
disruptive  technology,  in  need  of  human  sciences  research.  They  point  out  that  EVS  has  been 
successfully  employed  in  large  computer-controlled  systems,  for  example,  aboard  a  ship,  and  that 
recent  improvement  in  computing,  energy  efficiency,  and  the  miniaturization  of  components 
allow  the  use  of  EVS  for  smaller  ground  and  air  systems.  The  concept  of  ET  for  air  or  land 
vehicle  systems  is  not  well  known  or  understood  within  the  CF,  although  some  allies  have 
embraced  the  idea.  The  Royal  Netherlands  Air  Force  (RNLAF)  for  instance  has  explored  the  use 
of  ET  with  the  F-16  aircraft  in  anticipation  of  the  use  of  ET  in  the  F-35  Joint  Strike  Fighter 
aircraft  [13].  Simulated  threats  were  fed  to  the  on-board  sensors  allowing  several  pilots  to  practice 
tactical  manoeuvres  beyond  visual  range.  Emerging  technologies  such  as  flexible,  translucent 
displays  may  soon  permit  EVS  for  training  tactical  manoeuvres  within  visual  range,  although 
many  human  factors  will  need  to  be  addressed  [14]. 
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3  Key  Barriers 


The  US  National  Academy  of  Engineering  has  identified  VR  among  the  14  grand  challenges  for 
engineering  in  the  21st  century  [15].  The  engineering  hurdles  include  advances  of  visual,  sound, 
touch  and  motion  displays  for  high  fidelity  representations  of  the  real  world.  The  need  to  simulate 
touch  and  realistic  “virtual  people”,  which  interact  naturally  with  the  user,  are  identified  as 
particularly  formidable  problems.  Elaptic  interfaces,  including  force  reflection  and  touch,  are  now 
inadequate  and  often  expensive.  Realistic  virtual  humans  are  still  beyond  the  capabilities  of  real¬ 
time  computer  graphics  and  artificial  intelligence.  Y et,  we  have  known  for  a  long  time  that  high 
fidelity  is  often  not  needed  for  effective  training  [16-23].  There  is  also  evidence  now  that 
humans  can  respond  to  crude  representations  of  virtual  people  the  way  they  respond  to  other 
humans  [24],  and  there  is  evidence  that  humans  can  learn  their  part  of  a  challenging  team  task  in 
a  VE  that  includes  relatively  simple,  interactive  models  of  their  team  mates  [e.g.,  25],  Elence, 
knowledge  about  the  extent  to  which  we  need  to  provide  haptic  cues  or  to  simulate  human 
appearance  or  behaviours  for  particular  applications  is  a  barrier  to  the  use  of  VR  for  training. 

Although  VR  could  help  the  CF  modernize  individual  training  and  education  (IT&E)  as  well  as 
collective,  joint  and  coalition  training  by  providing  inexpensive  and  effective  technologies,  it 
might  undermine  some  established  defence  industries  in  Canada  that  now  sell  expensive,  full 
mission  simulators.  In  weapon  system  design,  VR  can  impact  the  need  for  training  and  force  early 
consideration  of  ET  as  a  system  requirement,  thereby  affecting  the  initial  specifications  and  life 
cycle  management  of  operational  platforms.  Resistance  to  change  firmly  entrenched  concepts 
about  how  to  design  and  use  training  technology  effectively  presents  a  barrier  to  the  use  of  VR, 
particularly  EVS.  The  many  uses  of  VR  provide  opportunities  to  leverage  “know  how”  and 
advancements  in  other  fields,  such  as  internet-based  social  networking,  for  use  in  training. 
Elowever,  the  variety,  rapid  pace  of  development,  and  many  uses  of  the  enabling  technologies  for 
VR-based  systems,  coupled  with  a  lack  of  knowledge  about  their  potential  impact  on  human 
behaviour  is  a  scientific  and  engineering  challenge. 

Current  barriers  to  the  use  of  VR  for  training  are  user  acceptance  and  unwanted  side  effects,  such 
as  simulator-induced  sickness  or  visual  problems,  which  can  cause  discomfort  or  a  safety  risk 
[26].  Consequently,  a  key  barrier  to  the  use  of  VR  is  a  better  understanding  of  the  limitations  and 
capabilities  of  VR,  which  is  an  ongoing  human  factors  and  behavioural  sciences  problem.  Other 
significant  barriers  include  the  following:  (1)  general  ignorance  about  the  behavioural  sciences  of 
training  technology,  as  illustrated  by  naive  beliefs  in  high  fidelity  by  lay  persons  as  well  as 
engineering  and  procurement  officers  [22],  (2)  user  opposition  to  the  use  of  any  type  of  simulator 
technology  because  it  is  perceived  as  a  threat  to  the  continued  use  of  operational  equipment  for 
training,  (3)  lack  of  verification,  validation  and  accreditation  (VV&A)  of  training  simulators  by 
DND,  (4)  use  of  specifications  by  civilian  regulators  to  define  military  training  systems  [27],  (5) 
an  uncoordinated  approach  to  the  exploitation  of  M&S  (e.g.,  expensive  simulators  are  purchased 
by  a  program  manager  to  train  a  few  individuals  with  little  regard  for  wider  team  training,  reuse 
of  components,  or  compatibility  with  other  simulators  within  DND  or  outside),  (6)  the  lack  of  an 
overarching  policy,  plan,  or  body  for  managing  and  applying  M&S  as  a  coiporate  resource  within 
DND,  and  (7)  decentralized,  ad  hoc  solutions  for  training  problems  without  reference  to  similar 
problems  or  solutions  within  the  CF  [28],  The  lack  of  a  holistic,  enterprise-wide  approach  to  the 
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procurement  and  management  of  M&S  or  IT&E  solutions  is  a  barrier  to  the  use  of  VR  for 
training. 
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4  Key  Drivers 


Strategic  drivers,  such  as  the  rapid  change  in  demands  upon  the  military,  non-traditional 
activities,  uncertainty  about  the  strategic  environment  and  a  growing  use  of  network-enabled 
capabilities  in  operational  systems  are  some  reasons  why  reconfigurable,  portable,  and  embedded 
VR  training  solutions  are  needed.  The  need  to  deploy  on  short  notice  and  the  need  to  learn  to 
adapt  to  an  agile  adversary  are  reasons  for  pursuing  embedded  training  solutions.  The  costs,  risks, 
constraints  and  resource  demands  (on  people  and  equipment)  associated  with  training  on 
operational  equipment  or  full-mission  simulators  at  home  are  other  reasons  for  seeking  affordable 
VR  as  an  alternative.  Technological  pull  is  another  driver;  as  sensory  displays,  computer 
graphics,  computer  networking,  and  gaming  technologies  advance,  and  as  data  sources  and  open- 
source  software  become  more  readily  available  for  use  in  VR,  they  entice  use,  by  novices  and 
knowledgeable  training  developers  alike.  Since  there  are  gaps  among  the  human  sciences, 
engineering,  uses  and  acceptance  of  VR  as  a  solution  for  training,  R&D  and  education  are  needed 
to  advance  VR  and  its  understanding  within  a  larger  framework  for  M&S  and  IT&E.  Also,  the 
potential  use  of  VR  for  capturing  the  knowledge  of  subject  matter  experts  is  a  driver  since  many 
experienced  personnel  will  soon  retire  from  the  CF  and  their  expertise  could  be  lost  without  an 
intervention.  Similarly,  embedded  VR  may  be  able  to  capture  data  from  training  or  battlefield 
environments  to  obtain  and  preserve  lessons  that  will  aid  future  military  readiness. 
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5  Technological  Maturity 


Although  some  successful  applications  of  VR  for  training  have  existed  for  many  years  [29], 
inflated  expectations  abounded  in  the  early  1 990s  with  the  popular  enthusiasm  that  was  generated 
by  low-cost,  head  mounted  displays.  Since  then,  an  appreciation  of  the  human  factors  of  VR  has 
informed  many  productive  applications  [30].  Because  VR  is  enabled  by  technologies  covering  a 
range  of  maturities,  as  illustrated  by  their  plot  on  an  innovation  cycle  [31],  it  is  not  possible  to 
make  a  general  statement  about  the  maturity  of  VR  for  training  since  the  readiness  of  a  solution 
will  depend  upon  the  particulars  of  the  application,  the  performance  objectives,  the  characteristics 
of  the  trainees,  the  implications  of  these  factors  for  interface  design,  and  the  limitations  and 
capabilities  of  the  enabling  components  that  are  chosen  for  the  solution.  In  short,  VR  is  ready 
now  for  some  training  applications.  Emerging  technologies,  for  example,  augmented  reality, 

EVS,  and  human  behavioural  modelling  are  less  mature,  but  offer  new  capabilities  by  extending 
the  use  and  efficacy  of  VR  as  a  solution  for  military  training.  The  continuing  advance  of  VR 
technologies  with  the  advance  of  a  human  sciences  foundation  afford  a  means  to  outpace  agile 
adversaries  able  to  take  advantage  of  the  proliferation  of  technologies  that  can  be  adapted  to 
training. 


DRDC  Toronto  TM  201 1-1 14 


6  Discussion  &  Conclusion 


This  paper  proposes  that  VR  has  been  and  continues  to  be  a  disruptive  technology  because  it 
provides  a  means  for  friendly  or  opposing  forces  to  gain  the  benefits  of  large  investments  in  M&S 
without  the  associated  expenses  of  traditional  simulators.  VR  is  disruptive  because  it  allows  an 
adversary  to  train  individuals  and  teams  with  commercially-available  hardware  and  software,  at 
low-expense,  unobserved.  VR  coupled  with  other  disruptive  technologies,  such  as  wide-band 
wireless  communications  and  intelligence  gathering,  could  provide  a  future  means  for  Canada  and 
her  allies  to  regain  a  military  training  advantage  if  VR  is  used  for  embedded  training.  Major 
benefits  could  be  obtained  with  deployed,  just-in-time  training,  mission  planning  and  mission 
rehearsal.  The  use  of  VR  for  these  purposes  would  require  the  use  of  (expensive)  operational 
equipment  and  early  consideration  of  the  human  factors  that  affect  learning  and  training  transfer. 
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List  of  symbols/abbreviations/acronyms/initialisms 


CASE 

Canadian  Advanced  Synthetic  Environment 

CF 

Canadian  Forces 

DND 

Department  of  National  Defence 

DRDC 

Defence  Research  &  Development  Canada  Embedded  Training 

ET 

Embedded  Training 

EVS 

Embedded  Virtual  Simulation 

FITE 

Future  Immersive  Training  Environment 

IT&E 

Individual  Training  and  Education 

JCTD 

Joint  Capability  Technology  Demonstration 

M&S 

Modelling  and  Simulation 

MRTT 

Mission  Rehearsal  Tactical  Trainer 

NATO 

North  Atlantic  Treaty  Organisation 

RNLAF 

Royal  Netherlands  Air  Force 

SE 

Synthetic  (or  Simulated)  Environment 

US 

United  States  of  America 

VV&A 

Verfication,  Validation  and  Accreditation 

VE 

Virtual  Environment 

VR 

Virtual  Reality 
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